On the Algebraic Structure of Certain Partially Observable Finite-State Markov Processes

نویسنده

  • Alan S. Willsky
چکیده

We consider a class of nonlinear estimation problems possessing certain algebraic properties, and we exploit these properties in order to study the computational complexity of nonlinear estimation algorithms. Specifically, we define a class of finite-state Markov processes evolving on finite groups and consider noisy observations of these processes. By introducing some concepts from the theory of representations of finite groups, we are able to define a pair of "dual" filtering algorithms. We then study several specific classes of groups in detail, and, by developing a generalization of the fast Fourier transform algorithm, we derive an efficient nonlinear filtering algorithm. A continuous-time version of these ideas is developed for cyclic groups.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Partially Observable Markovian Maintenance Process with Continuous Cost Functions

In this paper a two-state Markovian maintenance process where the true state is unknown will be considered. The operating cost per period is a continuous random variable which depends on the state of the process. If investigation cost is incurred at the beginning of any period, the system wit I be returned to the "in-control" state instantaneously. This problem is solved using the average crite...

متن کامل

Finding the Value of Information About a State Variable in a Markov Decision Process

Finding the Value of Information About a State Variable in a Markov Decision Process Gilvan C. Souza The Robert H. Smith School of Business, The University of Maryland, College Park, MD, 20742 Phone: 301-405-0628; fax: 301-405-8655; email: [email protected] ABSTRACT In this paper we present a mixed–integer programming formulation that computes the optimal solution for a certain class of Markov dec...

متن کامل

On the Undecidability of Probabilistic Planning and Infinite-Horizon Partially Observable Markov Decision Problems

We investigate the computability of problems in probabilistic planning and partially observable infinite-horizon Markov decision processes. The undecidability of the string-existence problem for probabilistic finite automata is adapted to show that the following problem of plan existence in probabilistic planning is undecidable: given a probabilistic planning problem, determine whether there ex...

متن کامل

On the Average Cost Optimality Equation and the Structure of Optimal Policies for Partially Observable Markov Decision Processes*

We consider partially observable Markov decision processes with finite or countably infinite (core) state and observation spaces and finite action set. Following a standard approach, an equivalent completely observed problem is formulated, with the same finite action set but with an uncountable state space, namely the space of probability distributions on the original core state space. By devel...

متن کامل

Approximate Linear Programming for Constrained Partially Observable Markov Decision Processes

In many situations, it is desirable to optimize a sequence of decisions by maximizing a primary objective while respecting some constraints with respect to secondary objectives. Such problems can be naturally modeled as constrained partially observable Markov decision processes (CPOMDPs) when the environment is partially observable. In this work, we describe a technique based on approximate lin...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Information and Control

دوره 38  شماره 

صفحات  -

تاریخ انتشار 1978